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A METHOD AND DATA-REDUCTION TABLES FOR DETERMINING THE RESOLUTION OF 
CAMERA SYSTEMS UNDER TYPICAL FIELD CONDITIONS 


This report describes a method and presents data reduction tables 

for use in evaluating the resolution of camera systems under test 
conditions typical of field use. The test method and data reduction 
tables were developed by the Photographic Division of the Engineering 
Services Department of the Naval Ordnance Laboratory (NOL), as part 
of the “High Acuity Experimentation II" program, which was conducted 
for Rome Air Development Center, Griffiss Air Force Base, 
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INTRODUCTION 

Resolving power tests have long been used to assess the image qual- 
ity of photographic systems under laboratory conditions. In an effort 
to apply the principles of laboratory-type resolving power tests to 
field testing of complete photographic systems, the Naval Ordnance 
Laboratory, White Oak, has prepared large-scale resolution targets 
suitable for use at distances typical of those encountered under 
field conditions. Although the method by which resolving power test 
imagery is translated into quantitative data is fairly simple, prepa- 
ration of data from large quantities of these tests invelve numerous 
time-consuming calculations. To simplify this task, the Laboratory 
has also prepared a set of computer-generated data reduction tables 
which are based on the associated large-scale resolution targets. 


These data reduction tables can be used to determine the resolving 
power of camera and other optical systems under actual field condi- 
tions. They are also useful to the optical metrologist for designing 
resolution experiments. The purpose of this report is to explain the 
use of the data reduction tables, to provide the background by which 
they were developed, and to suggest possible applications. 


The reader who has not had prior experience in performing resolving 
power tests (such as work with an optical collimator, National Bureau 
of Standards (NBS) targets at 21 focal lengths, etc.) should famil- 
iarize himself with two publications: A Method of Determining the 
Resolving Power of Photographic Lenses, NBS Circular SUT (available 
from Superintendant of Documents, Government Printing Office (GPO), 
Washington, D.C.); and MIL-STD 150A, Photographic Lenses (also avail- 
able from Superintendant of Documents, GPO, Washington, D.C.). 


BACKGROUND 

Under a contract with Rome Air Development Center, Griffiss Air 
Force Base, Rome, New York, (entitled High “cuity Experimentation II, 
MIPR No. F30602-71-X-0003) the Photographic °.-.s on of the Naval 
Ordnance Laboratory investigated the performance of a number of popu- 
lar 35mm still cameras. A major portion of the investigation was to 
quantitatively determine typical field perforinance, reflecting the 
effects of atmospheric haze, mount stability, and operator variability 
among other factors. It was decided to use resolving power tests as 
the primary means of evaluation because of their simplicity, ease of 
evaluation, and because the overall program concerned the recording 
of threshold-quality imagery. 
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Normally, resolution tests are run under carefully controlled condi- 
tions at either relatively close distances or with the aid of an 
optical collimator. Provisions are made for eliminating camera vibra- 
tions and other effects which might degrade the quality of the data. 


The test conditions used to determine typical field performance 
are considerably different, however. For the purposes of the NOL 
field testing program, the resolution targets had to be suitable for 
a wide range of conditions, including use with focal lengths of 35 to 
1400mm and object distances in excess of one mile. A search was made 
to locate a suitable off-the-shelf target, but when none could be 
found, a large-scale resolution target based on the USAF 1951 Design 
was prepared (see Figure 1). Its 40 x 42 inch size (including mar- 
gins) permits easy carriage and mounting in field use but it is 
large enough to be used at typical object distances. The largest 
resolution pattern can be detected with a 135mm lens at 2000 feet 


with an effective camera-system resolving power of 72 lines per mil- 
limeter. 


DETERMINATION OF CAMERA SYSTEM QUALITY USING DATA REDUCTION TABLES 
After making a series of negatives of the résolution target and 
determining the smallest resolvable target on each negative by means 
of a 30-to 40-power microscope, one would normally compute the image 

plane resolution using the width of the target bar, the lens focal 
length, and the object distance. To simplify this task, data re- 
duction tables (provided as Appendix C) have been prepared and espec- 
jally keyed to the NOL large-scale test target. These tables facil- 
itate direct and rapid determination of the image plane resolution 
for 48 lens focal lengths of 10 through 2000mm, at each of 12 typical 
object distances. A second series of tables allows determination of 
system resolution when the object distance and focal length are either 
unknown or are not listed in the tables. In either of these latter 
situations, the user selects a table based on system magnification 
determined by measuring the actual image size of the target as 
recorded on the film, 


RESOLVING POWER TARGET DESIGN 

The NOL large-scale resolution target is based on the design of 
the “USAF-1951" resolution target. The NOL target (Figure 1) consists 
of 36 target elements decreasing in spatial frequency as the sixth 
root of two{</2 approximately 12 percent). The geometric design of 
the target elements and associated terminology are presented in MIL- 
STD 150-A. A standard target element consists of two patterns (two 
sets of lines) which are oriented at right angles to each other as 
shown in Figure 2, Each pattern in turn consists of three bars and 
two included spaces, all of equal width. The length of the bars is 
five times the bar width. A bar or a space is referred to as an 
interval, while the combination of a bar and a space is referred to 
aS a unit. The unit width is used to compute the spatial frequency 
of the pattern, 


To facilitate the microscopic examination of the test imagery, the 
36 elements are organized into sets of six, eaci, set being referred 
to as a group. Figure 2 illustrates a single target group. The NOL 
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FIG. 1 LARGE-SCALE RESOLUTION TARGET 
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FIG. 2 RESOLUTION GROUP MINUS SIX SHOWING APRLICABLE TERMINQLOGY 
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target consists of groups "minus six" (-6) through "minus one" (-1l). 
Each group in turn consists of six elements. The group number indi-~ 
cates, in terms of powers of two, the number of lines per millimeter 
of the largest pattern within the group: 
Resolution = 2* 
where K is the group designation. i 


For example, in group “minus three": 
g 


ae 
= 1 
(2)3 
R = 1/8 = 0.125 Lines/mm 
The resolution of any pattern can pe computed using the formula: 
rea 
rao*® 6 


where K is the group iesignation and N is the element designation. 


The targets were prepared using two techniques. A full size 
40 x 42 inch high contrast negative was made on polyester-based 
lithographic film using a process camera and a smaller format master. 
This negative was then used to make contact prints on resin-coated 
(dimensionally stable) photographic paper. Contact prints were made 
at three levels of contrast. The contrast ratios and density differ~ 
ences of the target lines and spaces were as follows: 


High Contrast - 1090:1 (AD = 2,00) 
Medium Contrast - 6.3:1 (AD = 0.86) 
Low Contrast - 1.6:1 {4D = 0.20) 


All targets consisted of dark lines on a light background. 


Although very satisfactory, photographic targets were expensive 
to make due to the time required to accurately assemble the matrix 
of prints into a 40 x 42 inch target. A second set of relatively 
inexpensive targets was prepared by printing the targets on heavy 
card stock using offset lithography. These targets, 40 inches high 
by 42 inches wide, including margins, were produced in high contrast 
only, having black lines on a white background. The array of resolu-~ 
tion patterns (excluding the element and group designations) is 
approximately thirty inches square. 


The Graphic Arts Research Center of Rochester Institute of 
Technology, Rochester, New York, 14623, is planning to market large- 
scale resolution targets similar to those described in this report. 
The targets will be printed on both paper and card stock in high, 
medium, and low contrast. 
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DATA REDUCTIC™ TABLES; ee 
The Data Reduction Tables are included in this report as 
Appendix C consist of four Sections: as follows: 


Section (A) Nominal Dimensions of Resolving Power Test 
Target; 


Section (B) Resolving Power Data Tables for Specific Lens 
Focal Length/Object Distance Combinations; 


Section (C) Tabulation of Camera System Magnifications and 
Resultant Image Sizes; 


Section (DB) Resolving Power Data Tables for Specific Camera 
Magnifications. 


A description of each section is provided below: 


(A) NOMINAL DIMENSIONS OF RESOLVING POWER TEST TARGET. This single- 
page section presents the nominal dimensions of the interval widths 
and unit widths of elements one through six of groups “minus six" 
through “minus one". Dimensions are given in terms of inches as well 
as millimeters. The data reflects the theoretical design goals; the 
actual dimensions on the targets vary from these values due to limi- 
tations of the reproduction process. Definitions are presented for 
pertinent terminology. 


(B) RESOLVING Fonene DATA REDUCTION TABLES FOR SPECIFIC LENS FOCAL 
LENGTH/OBJECT DISTANCE COMBINATIONS. This section contains data 
raducticn tables ir is lens Tocal lengths at each of 12 selected 
object distances. The lens focal lengths presented range from 10mn 
to 2000mn. Tre 12 object distances vary depending on the lens focal 
length. (The tables for 35mm lenses range from 10 feet to 400 feet, 
whereas the tables for 1000mm lenses range from 150 feet to 
5000 feet.) ?bove each data table is a four-line heading containing 
the following information: 


Lens focal length in millimeters; 
Object distance in feet and meters; 
Image magnification; 


Size of image in millimeters and inches. 


#\ description of the computer program used in generating the data 
reduction tables and the program itself are provided in Appendices A 
and B. 


Smee rete ners 
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Each data table consists of a six-by~six array of resolution values. 
The vertical columns denote groups “minus six" through “minus one", 
while the horizontal rows denote the elements. 


: The resolution values, which are presented in terms of lines-~per- 
millimeter, represent computed theoretical data, not test data. The 
data presented in the tables is independent of the quality of the 

: optical system under evaluation. The quality of the optical system 
comes into play by determining the smallest target which is resolved, 
For a given lens focal length and object distance, a quality system 
may resolve the “minus four” group, “element three" target, (79.9 
lines per millimeter); whereas a poorer system might resolve only the 
“minus five" group, element two target, (35.6 lines per millimeter). 


Tests using a focal length/object distance combination not explic- 
itly listed can often be readily evaluated by applying a simple 
factor to one of the existing tables. As an example, there is no 
table presented for evaluation of a 75mm lens at 750 feet. To compute 
the resolution of this combination, one refers to the 150nu0/1500-foot 
table. The resolution value may be read directly from the table 
because the computed data for a 75mm lens at 750 feet would be iden- 
tical to that provided for the 150mm lens at twice the distance. As 
long as the ratio of focal length to distance remains the same 
(e.g., 250mm at 1000 feet vs 1000mm at 4000 feet, atc.), the results 
can be read directly from any analogous table. This type of substitu- 
tion does not result in any error. 


If no ratio extension is available, another method may be employed. 
For example, data is not presented for evaluating a 135mm lenses at 
125 feet and no multiples of the 135mm focal length are presented. 
However, a table does present data for 135mn lenses at 250 feet. 
Although the ratio is not the same, a resolution value can be approxi- 
mated by reference to the 250-foot table and multiplying the value by 
two, This multiplication compensates for the two-to-one ratio of the 
object distances. Performance values determined by this method will 
generally be accurate within one percent. This 18 not a significant 
error considering that the selection of the target image resolved 
involves a choice of elements which vary by 12 percent. 


To simplify the format of the data tables, all computed resolution 
values which are equal to or exceed 1000 lines per millimeter are 
given as 999.9, 


: The tables presented in Section B can be used to good advantage by 
anyone designing resolution experiments. If the object distance 
which is selected for a particular test is too short, all targets 

° will be resolved and the test would yield no data. Conversely, if 
the distance is excessive, none of the targets will be resolved. The 
following procedures can be followed to eliminate these situations 
however: 


1. Make an estimate of the number of lines per millimeter which 
can be resolved by the system. Past experience with the film/lens/ 
camera combination is a good guide. 
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2. Refer to the page containing the lens focal length to be 
tested. 


3. Scan the tables to locate a table based on any convenient 
object distance which lists the estimated system performance in 
groups "minus two" through "minus five." Groups “minus one" and 
“minus six" are for safety margins only and should not be used in 
determining the test distance. 


As an example, consider a system which has an estimated resolving 
power of 80 lines per millimeter. If the test is to be performed 
at an object distance which lists 80 lines per millimeter at group 
"minus five," "element three.“ If the actual resolution of the 
system is only 40 lines per millimeter, a target will still be avail- 
able to provide the data. In this case, it would be the group "minus 
six," “element three," target which the table indicates is equal to 
40 lines per millimeter. Had we selected the distance where 80 lines 
per millimeter was listed at “minus six," “element three," no target 
would be resolved. 


(C) TABULATION OF CAMERA SYSTEM MAGNIFICATIONS AND RESULTANT 
IMAGE SIZES. In some testing situations, the object distance, focal 
Tength, or both will be unknown. A determination of system resolu- 
a tion can still be made under these conditions by determining the image 
4 size of the target on the resulting test film. This measurement, 
4 referred to as the "-6 Group Length," will then allow the selection 
of an appropriate data table. 


A traveling-stage microscope or other suitable instrument can be 
used to measure the length of the “minus six" group from the top of 


of its second element to the bottom of its sixth element (Figure 2). 

“4 The measurement may be in millimeters or inches, whichever is more 
. convenient. 

Pes Turning to the "-6 Group Length" table (Section C of Appendix C), 
ae one then scans the appropriate inch or millimeter column to locate 
~ the entry closest to the measured value. The corresponding value of 
_— magnification can be read from the adjacent colum. The tabulation 


of values in this table range from a magnification of 0.000139 to 

‘| * 0.034621 and vary with the 24th root of @ (We). Using the selected 

eo magnification value, one can refer to Section D which provides image 
plane resolution tables by magnification rather than by focal length 

| . and object distance. 


RO _ 4D) RESCLVING POWER DATA TABLES FOR SPECIFIC CAMERA MAGNIFICATIONS. 
a _ Format and use of these tables are identical to those in Section B of 
ma Appendix C. Svstem resolutions are determined from these tables in 
ae the manner previously described. Note that each table is valid for 
any system which produces the stated image size and magnification, 
regardless of the specific focal length and object distance used. 


| 
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APPLICATIONS OF LARGE-SCALE RESOLUTION TESTS 
There are numerous practical applications for large-scale resolution 
targets. Three typical examples are d! icussed below. 


Example 1 


Large-scale resolution targats allow p -ographic and other 
optical systems to be tested under condivions which are typical 
of their everyday applications. As such, these tests provide a 
quantitative measurement of the effectiveness of the system under the 
conditions normally encountered during actual use. 

The data gathered by these tests reflect the effects of atmospheric 
haze and shimmer, focusing accuracy, camera mount stability, etc. 
In many applications, these degradations are the dominant factors 
in determining the performance of the system. 


Example 2 


It is frequently worthwhile to compare actual field tests with 
reference or "control" tests (laboratory tests of the same equipment, 
or field tests made under more stringent conditions). Comparison 
tests of this type can reveal (1) whe percentage of resolution loss 
due to atmospheric haze, (2) the minimum shutter speed which can be 
used to hand-ho” a long lens while still maintaining a desired 
level of resoli' vo... (3) the minimam shutter speed required when 
photographing a moving object, or (4) the stability of one tripod 
versus another. 


The comparison of the two test conditions can identify that point 
(a minimum shutter spsed for example) where field data is not degrad- 
ed with respect to control] data, or it can be used to indicate 
percent resolution loss of field tests versus control tests. 


Example 3 


Large~scale resolution tests can be used to assess the object space 
resolution* of pictorial imagery. This technique was utilized in a 
recent NOL investigation which was concerned with determining the 
minimum image quality requirements necessary for identification of 
people. Typical results of increasing image quality and the associ- 
ated increase in certainty of identification are shown in Figure 3. 


This problem area was divided into three levels of pictorial 
quality: 


Object Space resolution: The spatial frequency of the target 
or the width of the target bar which is resolved in the photographic 


record. 


tt 


NOILMOSI¥ 33¥d5-193/80 4O NOL WMeRIl € 914 


*SOWVYd TV ‘NOLINIOS3Y INWId J9VWi 
UH Iv WW 8s ‘SND 
G Y3dNS NOIdOL YINISSIB WW SE ‘VaIWYD 


es iam fl} Ws (SS) wee | oo W=9 
: orn it wes gn Mi wes oo Ht i= 
1=> tae "2 WS? "2m "2, HS’ sam "3 HS 
pa rEm os? om rem oF? os roll ene — 
tHe < 4) Hiss eu Hee eat W=¢ 
¥ ; “= ~—_ "=i Ss aa 
GNIWMA 17) 2 WISIN Hi = é @ = i= — 4 Files l= — se 


eS 


X8S + NOLLYIISINSYW 


“TWNGLATONG 

NV 40 NOULYOISI NIG! MOTIY CINOM HOIHAN 
NOILN10S38 J9VdS- 19380 WAWINIW FHL INIW 
~YILIG OL 007 OL 02 WON SIONVISIG LY 3GWW 
SUIVd PT 30 13S ¥ WOYd ZUV SUIWd dd Ved 
-OLOHd YNOS JHL *.002 Or 52 WOUS SIINVISID 
FAVLWINISSYd9Y UACI LV dIHd VYSOLOHd 
"1394VL NOILMIOSIY NWIS-I9dV1 V GNV 

TA0OW V 30 SHdVADOLOHd CIHOLYW 38V WMOHS 


SPH 0) WW TE TT HIGIA 3NIS CAL CE WE SES MAGE INST bnS2T OE WN BEE MAGIA INIT 950 te Wie TPT HIG INI 


B IN3W313 5, dROYDS oof, INGETT3 B.. EPOD of. ININTT A. aed oF NDI WZ, SNGED 
*GAA10S3¥ 139NVI NEBAIOS 34 1PO4¥} *OIAWS Je LISS] *CINIOS5Y LIEK! 


002 oI 105 SZ 


° UG patgnnatnr enna anaes regener errr ne nc ie eee crete ne occ eee te nee ecg oot niente ene ne tne maperaneie oprah PEO RD IRE 


NOLTR 72-18 


41) Personnel Detection: To differentiate personnal from the 
adjacent background and to count the number of people 
present in the photograph; 


. (2) Personnel Recognition: To provide general descriptions of 
the personnel present in a photograph, i.e., sex, height, 
weight, hair color and length, presence of glasses, etc.; and 


(3) Personnel Identification: To identify beyond reasonable 
doubt the presence of a specific individual. 


To meet vach one of these standards successively, an increasing 
improvement in pictorial quality is required. 


An experiment was performed to determine the degree of object space 
resolution required for the above levels. Using a 58mm lens and 
Tri-X film, a group of five people and a large-scale resolution target 
were photographed at 14 separate distances, varying from 50 to 
2016 feet.* The resulting film was then analyzed to determine the 
smallest resolvable target at each distance. The width of the se- 
lected target bars was a direct measurement of the object-space reso- 
lution »resent ir. each negative. (Note that previous examples have 
been concerned with lines per millimeter on the film; here we are 
concernaei with the minimum size of the actual target lines which were 
successfully recorded.) A set of 40X enlargements was then produced, 
These prints ‘ere then exarined by several qualified interpreters to 
determine the lowest level of pictorial quality which could be toler- 
ated and still enab’e the interpreter to extract the information at 
the three required levels. (Although final conclusions have nut been 
made, it appears that an object-space resolution of 1/8 inch is 
necessary if one is to meer t.e “personnel identification" criteria.) 


Other Applications 


The NOL large-scale resolution targets and associated data 
reduction tables can alsc be used to evaluate night vision devices. 
surveyor's transits, telescopes, binoclars, and a variety of other 
optical devices under field conditions. 


*For this experiment, a second set of data reduction tables were 
prepared similar to those in Appendix C. The 24 object distances 
per lens focal length varied with the 37 ; e.g., 190, 126, 159, 
200, 318 feet, etc. 3 
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APPENDIX A 
DESCRIPTION OF COMPUTER PROGRAM 


The computer program used to generate the Resolving Power Data 
Reduction Tables is presented in Appendix B. The following descrip- 
tion of the program's functions and its data deck structure should 
enable others to modify the program to generate tabies for focal 
lengths and object distances not contained in Appendix C. 


The Fortran IV program was written to present resolving power 
data tables for (1) given lens focal lengths and associated object 
distances and (2) generated magnifications. The main program acts 
basically as an executive calling in the various subroutinss to 
perform computations, printing, etc. 


Subroutine FOCAL computes the image magnification, "-6 Group 
Length," and resolving power data for a given focal length and object 
distance. The resolving power for group “minus six," “element one" 
of each table (referred to in program as “result") is computed from 
the above variables, the remaining data in each six-~by~-six array is 
arrived at by multiplying the "result" by each of 35 stored constants, 
This routine also stores the resolution data along with the test. 
conditions, magnification, and "-6 group length". 


Subroutine GENER generates a series of magnification values based 
on choser (by data card) limits and power of two. 


Subroutine MAGNIFY computes the resolving power data tables for the 
generated magnifications values. 


Subroutine IMAGPRY prints the tabulation cf generated magnification 
values and the associated *°-6 group lengths’. 


Subroutine HEADER prints the tabulation of nominal target dimen- 
sions, notes, and nomenclature. 


Subroutine PAGPRT prints the 12 data tables per focal length and 
the heading above each table which lists the test conditions and 
associated data. 


Constraints within the program limit the number of input object 
distances, per data card, and the number of tables per page in the 
output to 12. Also, the total number of magnifications at any one 
time during execution (either generated or computed from focal 
lengths) is limited to 900. It should also be noted that any reso- 
lution value equal to or in excess of 1000.0 is set to 999.9. 
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On a CDC 6400, the program required an octal field length of 31,000 
during execution and required 33 seconds of central processor time 
to execute under the Fortran Extended Compiler. 


The data deck is structured as follows: 


CARD NO. COLUMNS VARIABLE DEFINITION 
1 1-5 N - Number of tables per page, 


not to exceed 12 (Right 
Adjusted). To obtain 24 ob- 
ject distances per focal 
length, use two input data 
cards per lens. 


eal a aa ae a eas aia oe ona ee ere 


6-10 MAG ~ Indicator of method of compu- 
tation to be used: a value of 
minus one (-1) will produce 
both the focal length tables 
(Section B) and the magnifi- 
cation tables (Section D). A 
value of zero (0) will produce 
only the focal length tables; 
a value of plus one (+1) will 
produce only the magnification 
tables (Right adjusted). 


11-15 NF - Total number of focal length 
data cards (Right adjusted). 
2 through 1-5, 6-10 - One focal length and up to 
(NF+1) 11-15~-+-56-60, 12 object distances (feet) 
61-65 per card (Right adjusted). 
NF+2 1-10 XMAX - Maximum desired value of 


generated magnifications 
(floating point). 


13-20 XMIN - Minimum desired value of 
generated magnifications 
(floating point). 


21-30 RCOT 2 - Root of two (2) used to build 
an Cee es values (floating 
point). A value of 24 was 
used to obtain the Section D 

4 tables which vary the magnifi- 

i cation value by the 24th root 

of 2. 


nee 
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APPENDIX B 


COMPUTER PROGRAM 
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